Distribution of Entropy Production for a Colloidal Particle in a 
Nonequilibrium Steady State 



o 
o 



(N 
o 

B 



T. Speck\ V. Blickle^, C. Bechinger^ and U. Seifert^ 



^ //. Institut filr Theoretische Physik, Universitdt Stuttgart, Pfaffenwaldring 57, 70550 Stuttgart, Germany 
^ 2. Physikalisches Institut, Universitdt Stuttgart, Pfaffenwaldring 57, 70550 Stuttgart, Germany 



PACS 05 . 40 . -a - Fluctuation phenomena, random processes, noise, and Brownian motion 
PACS 82 . 70 . Dd - Colloids 

Abstract. - For a colloidal particle driven by a constant force across a periodic potential, we 
investigate the distribution of entropy production both experimentally and theoretically. For 
short trajectories, the fluctuation theorem holds experimentally. The mean entropy production 
rate shows two regimes as a function of the applied force. Theoretically, both mean and variance 
of the pronounced non-Gaussian distribution can be obtained from a differential equation in good 
agreement with the experimental data. 
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Nonequilibrium steady states constitute arguably the 
simplest class of nonequilibrium systems. They are char- 
acterized by a stationary distribution but differ crucially 
from equilibrium states since detailed balance is broken. 
As a consequence, entropy is produced at an on average 
positive rate. Fluctuations of the entropy production to- 
wards negative values do occur but they are severely con- 
strained by the fluctuation theorem. This universal re- 
lation was first observed in the simulations of a sheared 
fluid [1] and later proven both for chaotic dynamic sys- 
tems [2] and for stochastic dynamics [3,4]. In principle, the 
fluctuation theorem is an asymptotic statement in the long 
time limit. If, however, entropy is assigned to the driven 
system as well and not only to the coupled heat bath, 
the fluctuation theorem holds strictly for finite times [5]. 
Closely related to the fluctuation theorem are the Jarzyn- 
: ski [6] and Crooks [7] nonequilibrium work relations, which 
' proved to be useful in the determination of equilibrium free 
energy differences in single molecule experiments [8,9]. 

The fluctuation theorem constrains the probability of 
negative entropy production. It does, however, not pre- 
dict the distribution for positive production which is, of 
course, a nonuniversal function. For a better understand- 
ing of nonequilibrium steady states [10], detailed studies of 
the entropy production in specific systems are important. 
Entropy production has been studied both experimentally 
and theoretically for a variety of systems including turbu- 
lent flows [11], granular systems [12], liquid crystals [13], 
and the ideal gas [14], mostly addressing the entropy pro- 



duction in the medium only. Entropy production including 
that of the system has been experimentally measured in 
an athermal two-level system [15] for which later numer- 
ical calculations of its probability distribution have been 
performed [16]. In the latter system, medium entropy is 
somewhat artifically defined and should not be associated 
with dissipated heat. 

Colloidal particles driven by time-dependent laser traps 
have developed into an ideal system for quantitatively 
studying these new concepts in nonequilibrium statisti- 
cal mechanics for essentially two reasons. First, individ- 
ual trajectories can be traced and recorded in real space 
in comparison to ensemble averages typically obtained in 
scattering experiments. Second, even though the particle 
in a distinct nonequilibrium steady state can be driven be- 
yond linear response, the surrounding fluid still faithfully 
behaves like an equilibrium thermal bath. In this letter, we 
exploit these features to analyze entropy production in a 
nonequilibrium steady state consisting of a single particle 
driven by a constant force across a periodic potential [17]. 
In contrast to previous experiments on colloids in time- 
dependent harmonic potentials [18,19] such a periodic po- 
tential in general leads to non-Gaussian distributions for 
quantities like applied work, dissipated heat and generated 
entropy [20]. In fact, we will show that even the mean en- 
tropy production rate shows an pronounced crossover as a 
function of the applied force. An additional advantage of 
such a colloidal system compared to driven bulk systems 
is that once the potential is known, the experimental data 
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angular position 

Fig. 1: Stationary probability distribution Ps{x) for a cosine 
input signal to the EOM with driving force / = 14.2fcBT//im. 
The inset shows the reconstructed actual potential V{x) with 
Vo = 65.6fcBT. 

can be compared to independent numerical calculations. 

We study a single colloidal particle in a toroidal geom- 
etry driven into a nonequilibrium steady state. The over- 
damped motion of the colloidal particle is governed by the 
Langevin equation 



i(t) = ^0 



dx 



+ at) = fioFix) + at) (1) 



with a periodic potential V{x + L) = V{x) and periodicity 
L. The thermal noise C describes the coupling of the par- 
ticle to the surrounding fluid modeling the heat bath with 
temperature T. The noise has zero mean and correlations 
(C(i)C('r)) = 2Do<5(i - r). The correlation strength Do of 
the heat bath is connected with the bare mobility of the 
particle /j,o by the Einstein relation Dq = k^TpLQ. The 
crucial assumption is that we require the heat bath to be 
and to stay in equilibrium at the constant temperature T . 
We can then identify the dissipated heat q as the change 
of entropy 



dr x{t)F{x{t)) (2) 



in the heat bath or medium along a single trajectory x{t) 
of length t [5,21]. Beside this entropy production in the 
medium, we can assign an entropy to the system itself even 
in nonequilibrium [5] by defining 



s{t) 



1 \nps{x{T)). 



(3) 



Here, the measured or calculated stationary distribution 
Ps{x) of the position in the steady state is evaluated along 
the specific trajectory x{t). Then the total entropy pro- 
duction Astot — Asni + As fulfills the fluctuation theorem 



P(-Agtot) 
P(+Astot) 



-Astot/^B 



(4) 



for any trajectory length where P(— Astot) is the prob- 
ability of entropy annihilating trajectories which is com- 
pared to those generating the same positive amount of 
entropy. 



The physical source of entropy production in our setup 
is the nonconservative force / which breaks detailed bal- 
ance and leads to a permanent dissipation of heat into the 
surrounding heat bath. Breaking of detailed balance is 
quantified by the mean local velocity Vs{x), i.e., the ve- 
locity averaged over the subset of trajectories passing x. 
With the stationary current js and probability Ps{x), the 
mean local velocity can be expressed as Vs{x) = js/ps{x). 
Introducing an effective potential 4'{x) = — Inps(x), the 
total force 

d4>{x) 



HoFix) = Vs{x) - Do- 



dx 



(5) 



splits into the local mean velocity and the gradient of the 
effective potential [22]. From the definition of the en- 
tropy (3) it is clear that the change of the effective po- 
tential along a stochastic trajectory equals the change in 
system entropy 



As = A;bA(/) = kB[(f)ixt) - (t){xo)], 



(6) 



where Xq and Xt arc the initial and final position of the 
particle, respectively. 

The change in medium entropy depends only on the 
initial and final position of the particle, since in our case, 
due to stationarity, Eq. (2) simplifies to 



TAsrn{xQ,xt) = -AV + fAx. 



(7) 



Beside the sum of system and medium entropy, we can 
obtain an independent expression for the total entropy 
production by inserting the force (5) into Eq. (2). We 
then get after one integration by parts and cancellation of 
the boundary term 



/"* 

Astot[a;(T)] = — / dr x{T)vsix{T)), 
F>a Jo 



(8) 



which depends on the whole trajectory x(t). 

We generate a nonequilibrium steady state experimen- 
tally by driving a single silica bead with diameter 1.85 fim 
along a toroidal trap with radius Ro — 2.2 fj,m imply- 
ing a periodicity of L = 2'kRo. The trap is created by 
tightly focused optical tweezers rotating with a frequency 
of i^T — 510 Hz [23]. At this frequency, the particle ex- 
periences a periodic driving force whenever it is "kicked" 
by the passing laser beam but the particle cannot follow 
the beam directly. Since video microscopy is not able 
to resolve these single kicking events [due to its spatial 
(50 nm) and temporal (50 ms) resolution], the particle is 
effectively subjected to a constant force /, thus driving it 
into a nonequilibrium steady state [24] . An additional pe- 
riodic potential V{x) (see Fig. 1) with depth X^o is created 
by modulating the intensity of the optical tweezers with an 
electro-optical modulator (EOM) whose input is synchro- 
nized with the tweezers' scanning motion. The potential 
V(x) and the driving force 



fioL 



dx Vs{x) 



(9) 
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(JV) 



As after t = 5 s 



Fig. 2: a) The diflterence S = As 
between the total entropy production (10) determined from 
a discretely measured trajectory and the sum of medium (7) 
and system entropy (6) for parameters Vb = 80.4fcBr and / = 
IGAkBT/ fim. b) Mean entropy production rate a determined 
numerically for a potential V{x) = (Vb/2)cosa; versus driving 
force /. The dotted line indicates the limiting behavior a « 
for large forces and the arrows mark the critical forces fc = 
Vo/(2i?o). 



are reconstructed from the measured distribution Ps{x) 
and current js [25]. 

The position of the particle in polar coordinates is sam- 
pled with frequency 20 Hz. The deviation of the radial 
component Sr ~ 0.06 fim with Sv/Rq < 3% is small 
enough to justify the assumption of an effectively one- 
dimensional motion. We record one long trajectory from 
which we determine the stationary probability Ps{c() of the 
angular position a shown in Fig. 1. The trajectory is then 
divided in overlapping segments of N points such that the 
angles a,; with 1 ^ i ^ N form discrete trajectories. The 
total entropy production along one discrete trajectory is 
calculated from Eq. (8) as 



As. 



(AT) 

tot 



■ d2 



i+i 



Do 



1=2 



2ps(aj) 



(10) 



In Fig. 2a, the deviation i5 = Asj^"* — Asm — As of the total 
entropy production (10) from the independently measured 
medium entropy production (7) and the entropy produc- 
tion of the system itself (6) is shown. This deviation is a 
Gaussian centered around zero with a standard deviation 
of 3.5/cb, which corresponds to a relative error < 3% given 
the mean (Astot) — 121.3fcB. This small error shows that 
the discretization of the stochastic velocity i within the 
integral Eq. (8) is a very good approximation even for a 
time resolution of 50 ms. This is not obvious a priori due 
to the mathematically nondifferentiable stochastic paths 
x(t). 

In Fig. 3, the data are plotted in the form of the fluc- 
tuation theorem (4) for different trajectory lengths t. The 
fluctuation theorem can only be tested directly in a small 
window of the histogram centered around zero due to the 
need for negative events. Since the distribution P(Astot) 
shifts towards larger values with increasing time, negative 
values of Astot become less probable and the statistics is 
good enough only for relatively small times. 



Fig. 3: a) Test of the fluctuation theorem (4) for t = 0.75 s, 
where the logarithm ln[P(+Astot)/f'(— Astot)] is plotted ver- 
sus Astot. The dashed line indicates the expected slope of one 
and in b) the effective slope is plotted with increasing trajec- 
tory lengths. (Parameters; Vb = 65.6kBT, f = 14:.2kBT / fim) 



The driving force / tilts the potential V{x) and lowers 
the potential barrier which at the critical force fc vanishes 
and deterministic running solutions start to exist. For a 
cosine potential, the critical force turns out to be fc — 
Vo/(2i?o)- In Fig. 2b, the mean entropy production rate 

a ^ (5,Astot) = ^{v!) = ^j^Rl r <iap-\a) (11) 

is plotted versus the driving force for three potential 
depths Vq. The two limiting cases 



{Aw/T)rK (/«/c) 



(12) 



are understood easily. For large forces f ^ fc, the po- 
tential becomes irrelevant and the particle diffuses freely 
with drift velocity oc /. The mean entropy produc- 
tion rate in this case becomes (/xq/?^)/^- For small 
forces f fc, the particle is mostly trapped within one 
minimum from which it escapes with the Kramers' rate 
fK — i~o exp{(— Vq + fL/2)/k'QT} where tq is the attempt 
rate [26]. If the particle moves to the next minimum, the 
driving force has spent the work Aw = fL. 

This crossover can also be observed in the histograms 
of Astot • In Fig- 4a, the case with the critical force f — fc 
is plotted. The work spent by the driving force is the 
product of force times the displacement of the particle 
such that trajectories corresponding to n revolutions of 
the particle lead to an entropy production peaked at the 
dashed vertical lines with Astot = nAw/T. In Fig. 4b, the 
potential depth Vb has been decreased at the same driving 
force, leading to / > /c. In this case the distribution 
of Astot starts to "run", i.e., the peak positions are not 
fixed anymore at the vertical lines. However, this is where 
they still reach their maximum as demonstrated by the 
rightmost histogram for i = 21.5 s. 

The probability distribution P(Astot) of the total en- 
tropy production is a nonuniversal function distinctly non- 
Gaussian and evolving in time. In order to compare 
the experimental data to theory, we need to calculate 
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total entropy production As^^^ [k^] 



Fig. 4: Histograms of total entropy production Astot at the 
crossover from locked to running state: a) Vb = 80.4fcBT and 
/ = WAksT / nm which corresponds to the critical force, b) 
Vo ~ Gl.TksT and the same force / = WAksT / fim corre- 
sponding to the running state. In both graphs, the left his- 
tograms (closed bars) are recorded for trajectories of length 
t = 2 s, the right histograms (hatched bars) for t = 20 s. In 
addition, b) shows as a solid line for t — 21.5 s an almost 
symmetric histogram (with respect to its peak). The dashed 
vertical lines are separated by the amount of work Aw — fL 
spent by the driving force / in one revolution. The insets dis- 
play the tilted potentials V{x) ~ fx for the two cases. 

P(Astot) independently. In Ref. [27] an equation govern- 
ing the time evolution of the joint probability distribution 
p{x, r = Astot, i) was derived ^ . The conditional moments 
rrinix^t) = J dr r" p{x,r,t) are the contribution of all tra- 
jectories ending in x at time t to the moments 



Mn{t) = ((Astot)") = / dx m„{x,t) 



(13) 



of P(Astot)- Following Ref. [27], the time evolution of the 
conditional moments reads 



dmn{x,t) 

m 



= Lmn{x,t) + Sn(x,t) 



(14) 



where L = —dx [p,qF{x) — Dfjdx] is the Fokker-Planck op- 
erator determining the Brownian motion of the particle. 
The source term 



-nky 



ox 



Do 



TO„_i + n{n — l)/c| 



Dn 



^Eq. (22) in Ref. [27] was derived originally for the so called 
"housekeeping heat" Qhk- Since in our case Astot = Qhk/T, this 
equation holds also for the total entropy production. 
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Fig. 5: Comparison of a) the variance C'2{t) and b) the skewness 
C3{t) between experimental data and the solution of Eq. (14). 
The experimental data has been obtained from 120.000 trajec- 
tories for Vb ~ 65.6fcBr and / — lA.2k^T / ^m. k is the number 
of Fourier coefficients used for parameterizing the actual poten- 
tial V{x), see the inset of Fig. 1. The three regimes I, II, and 
III are discussed in the main text. 



couples the evolution of the nth conditional moment to„ to 
conditional moments of lower order where mo(x) — Ps{x) 
is the stationary solution of Lttiq ~ 0. 

For the numerical calculation, we use the experimen- 
tally obtained potential V{x), driving force /, stationary 
current js, and probability distribution Ps{x) for the run 
shown in Fig. 1 measured in the vicinity of the critical force 
/ ~ /c. Because of the periodicity of mo(x + L) = mo{x), 
mn{x) as well as the source terms Sn{x) are also periodic 
for n ^ 0. Eq. (14) is therefore easily solved numerically 
in Fourier space which we have done for the first two mo- 
ments Mi^2- From these (i) the mean Mi and (ii) the vari- 
ance C2 = M2 — Ml are obtained. The mean Mi{t) = crt 
is a straight line from which we can extract a. First, we 
fit the experimental data with a ~ 17.15fcB/s. Second, we 
fit the numerical solution (13) leading to ct ~ 17.12fcB/s 
in excellent agreement with the experimental data. The 
latter value of a is also obtained from Eq. (11) which only 
involves the measured distribution Ps{x) and current js- 

In Fig. 5, we plot the variance C2 together with its 
experimental counterpart. The time-dependence of the 
variance C2 (t) resembles roughly that of the mean square 
displacement. During the first regime (I) in Fig. 5a, the 
particle explores its vicinity until it reaches on average the 
potential barrier. While surmounting the barrier (II), the 
spreading of the distribution slows down and then again 
increases approximately linearly (III) . Analyzing the data 
at the critical force f — fc demonstrates the sensitivity of 
the entropy production. The slope in regime III is espe- 
cially sensitive with respect to both the potential and the 
driving force. Therefore the force / used in the numerical 
calculations has been fitted with value / ~ 13.9kBT/ fim to 
match the experimentally determined C2{t). This corre- 
sponds to a deviation of about 2% compared to the value 
/ ~ lA.2k'QT / jjLTtv calculated from Eq. (9), which is well 
within the estimated error of the force. The accuracy of 
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the potential's parameterization is controlled by the num- 
ber k of Fourier coefficients used loading to a better agree- 
ment with higher value for k. Despite the good agreement 
for the mean and variance, the numerical calculation of 
higher cumulants shows an increasing sensitivity with re- 
spect to the accuracy of the measured quantities needed 
as input. 

In summary, we have measured experimentally the dis- 
tribution of the total entropy production caused by driving 
a colloidal particle in a toroidal geometry. The system ex- 
hibits a transition from exponentially small to quadratic 
mean entropy production rate depending on the ratio 
fL/Vo between driving force / and potential depth Vq, 
which can be seen in the histograms of the; c;ntropy pro- 
duction as well. The time evolution of the moments of 
the total entropy production is described by a differen- 
tial equation. The procedure outlined above becomes less 
reliable for higher cumulants due to accumulating errors 
with increasing trajectory length. For long trajectories, 
direct calculation of the asymptotic large deviation func- 
tion of the entropy production rate seems preferable. Its 
extraction from experimental data, however, might pose a 
challenge. 
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